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Abstract 



We review and extend the formalism introduced by Peliti, that maps 
a Markov process to a path-integral representation. After developing 
the mapping, we apply it to some illustrative examples: the simple 
decay process, the birth- and-death process, and the Malthus-Verhulst 
process. In the first two cases we show how to obtain the exact prob- 
ability generating function using the path integral. We show how to 
implement a diagrammatic perturbation theory for processes that do 
not admit an exact solution. Analysis of a set of coupled Malthus- 
Verhulst processes on a lattice leads, in the continuum limit, to a field 
theory for directed percolation and allied models. 
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I. INTRODUCTION 



It is often noted that nonequilibrium statistical mechanics lacks the comprehen- 
sive formalism of ensembles that has proved so useful in equilibrium. The reason is 
that equilibrium statistical mechanics treats stationary states for a special subclass 
of systems, that possess detailed balance. This allows one to bypass the dynamics, 
and study stationary properties directly. For systems out of equilibrium, we gener- 
ally do not have such a shortcut, and must deal with the full dynamical problem, 
even if our goal is only to obtain stationary properties. In the case of stochastic sys- 
tems with a discrete state space, the fundamental description is given by the master 
equation, which governs the evolution of the probability distribution. This class of 
problems includes a wide range of systems of current interest, that exhibit phase 
transitions or scale invariance far from equilibrium: driven lattice gases, birth-and- 
death processes such as directed percolation or the contact process, sandpile models, 
and interface growth models. 

One of the more powerful tools for studying stochastic models is a formalism 
that maps the process to a path- integral representation [l] . The mapping generates 
an effective action that can be studied using the tools of equilibrium statistical 
physics, for example, the renormalization group. Several methods for mapping a 
stochastic process to an equilibrium- like action have been proposed P|-p|,pT|,[7|,|8| . In 
these notes we review the method developed by Peliti ||, and apply it to some 
simple stochastic processes. This method has several advantages. With it, one 
can map any birth-and-death type process to a path-integral representation without 
ambiguity. In particular, the step of writing a Langevin equation, and of postulating 
noise autocorrelations, does not arise in this formalism. Thus it provides a direct 
path from the model of interest to an effective action, and (in the continuum limit), 
to its field theory, without the uncertainties that often attend the specification of 



the noise term [10|. A second advantage, which we explore in some examples, is 



that it leads to a systematic perturbative analysis for Markov processes. 

The principal aim of this article is to acquaint the reader with the formalism 
and provide a set of worked examples whose mastery will allow one to apply the 
method to problems at the frontier of research. While Peliti's article 0] provides an 
excellent exposition of the mapping, we include, for completeness, a derivation of 
the central formulas. Our development of the perturbation theory differs somewhat 
from Peliti's. Most of the applications discussed are also new. 

The balance of this article is structured as follows. In Sec. II we derive the 
path-integral representation, starting from the master equation. Sec. Ill presents 
an application to the simple decay process, and expressions for two-time joint prob- 
abilities. In Sec. IV we begin our discussion of diagrammatic perturbation theory 
for the probability generating function, which is illustrated with a pedagogical ex- 
ample. This is extended in Sec. V where we analyze the birth-and-death process 
using perturbation theory. In Sec. VI a perturbation expansion for moments of 
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the distribution is developed, which turns out to be much simpler than that for the 
full generating function. This method is applied to the Malthus-Verhulst process in 
Sec. VII. In Sec. VIII we illustrate another application of the formalism, showing 
how the path-integral description for a lattice of coupled Malthus-Verhulst processes 
leads, in the continuum limit, to a field theory for directed percolation. Sec. IX 
presents a brief summary. 



II. FROM THE MASTER EQUATION TO A PATH INTEGRAL 



In this section we recapitulate Peliti's derivation of the path integral mapping. 
We consider Markov processes in continuous time, and with a discrete state space 
n = 0,1,2,.... (We may think of n as the size of a certain population.) The 
probability p n (t) of state n at time t is governed by the master equation |TT|--[13|: 



-%T— = ~Pn(t) W « + WnmPm(t) , (1) 

(lb ™ ™ 



where w mn is the rate for transitions from n to m. (We study stationary stationary 
Markov processes, i.e., time- independent transition rates.) 

We now associate a vector \n) in a Hilbert space with each state n, [|J and for 
convenience define the inner product so: 

(m\n) = n\8 mtn . (2) 



The identity may then be written as 

i = E^I«>H- (3) 

(All sums run from zero to infinity unless otherwise specified. Note that while 
we make use of many pieces of notation familiar from quantum mechanics, we are 
dealing with c-number functions.) A probability distribution n (0 n > 0, J2 n 4>n — 
1), may be represented as a linear combination of basis states: 

|0> = £0». (4) 



The Hilbert space formalism is useful because it provides a simple way to express 
the evolution in terms of creation (7r) and annihilation (a) operators, which we define 
via: 

a\n) = n\n — 1) 7i\n) = + . (5) 
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These relations imply that [a, ir] = 1. Here again we note a fundamental difference 
from quantum mechanics: expected values are linear, not bilinear, in \<p). The mean 
population size, for instance, is given by 

E[n(t)} = ( \a\<l,(t)) , (6) 

where 

is the the projection onto all possible states. 

Central to our analysis will be the probability generating function (PGF), 

$>t{z) = Y.Pn{t)z n . (8) 



We denote the PGF corresponding to state |0) as (f)(z) = I] n 0„-2 ra . (Note that 
(f)(1) = 1 by normalization.) 

Next consider the inner product between states |0) and \ip): 

= E - } (</>\n)(n\1>) = E n! «» • ( 9 ) 



We can write this in terms of the corresponding PGFs if we note the identity 

(A \ m 
--A 5(z)=n\5 n , m , (10) 

which is readily proved, integrating by parts. (Unless otherwise specified, all inte- 
grals are over the real axis.) Then we have 

<</#> = J dz<P(z) J, 5{z) 

^<P(z)^z')e—' , (11) 

where we used the integral representation of the 5 function. 

For birth-and-death processes, it is always possible to write the master equation 
in terms of an evolution operator L composed of creation and annihilation operators 
(specific examples are considered below). The master equation then takes the form 
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(12) 



and has the formal solution 

\m = e Lt \m) = u t \m) ■ as) 

This evolution has its analog in the space of probability generating functions; it is 
for the analog of the operator U t in the PGF representation that we shall develop 
a path-integral expression. To do this we define, for any operator A in the Hilbert 
space, a function called its kernel: 

where A mjH = (m\A\n) are the matrix elements of A. Suppose = A\4>). The 
PGF corresponding to is 

n n n - 

Z n 1 

= H —An\A\m) — (m\4>) 

n\ ml J 2n 
= j d -^A(zXWC)e- KC ■ (15) 

We shall also require an expression for the kernel of a product of a pair of operators, 
A and B: 

TYl /~Tl 

z m ( n 5 r s 

= — -(m\A\r)(s\B\n)—-^j- 

n,m,r,s m - n - r - 



n,s 

J^A{z,r,)B{irf,Oe-^ . (16) 



Given an operator A, we may put it in normal form by commuting all creation 
operators to the left of all annihilation operators; it will then have the form: 
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A = Y J A m ^ m a n . (17) 



in. ii 



With this we associate the normal kernel: 

"^(^j ^ t A m ,n^ C 



m,n 



The ordinary and normal kernels are related via: 

A(z,() = e z <A(z } (). (19) 

[To prove Eq.(^) we show that the coefficients of z m ( m on the right- and left-hand 
sides are equal. The coefficient on the r.h.s. is: 



min[m,n| 



1 



—A 

* — * T I 

r=0 ' 



while on the l.h.s. it is simply A m ^ n /(m\n\). The matrix element, however, may be 
written so: 

A m ,n = A r ,s(m\iT r a s \n) 

r,s 

n n\ 
= z2z2-Ar,s-, '-^(m\n+r-s) 



r s =o [n-s). 

n i i min[m,n] i . 

. , mini J-^ mini 

A m -n+s,sJ— — 7J = 2^ A m -t,n-t Tj 
s=0 V 1 *)• t=0 b - 



which establishes the identity] 

We may now develop a path-integral representation for U t (z, (). To begin, recall 
Trotter's formula, which allows us to write: 

/ tr\ N 

Each factor in the product has a corresponding kernel, which, using Eq. (|19D , can 
be written 

1 + ^)^,0 = ^(1 + 1^,0) , (21) 

with C(z,Q the normal kernel of the evolution operator. Now using Eq. (|16j), we 
have 
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N-l 



U t (z,C)= Hm J] I / ^^e-^ 

N— >oo 



2tt 



fc=i 



1 + tf C ( ir ik>Vk-i) 



, (22) 



or, rearranging, 



N-l 



N->oo j=1 J 2tt [ fc=1 L A 

+ — £(z,77jv_i) + Z77JV_l| . 



(23) 



Finally, we let iV — > oo with t' = (k/N)t, rjk — > V'C*') an d ^ ~ ^ ^'(^O; to obtain a 
path-integral expression for U t (z,Q- 

U t (z,C) = J V-pV-p'exp i-J^dt' [iip'{t')ijj{t') - VO] + zip{t)\ , (24) 



where the dot denotes a time derivative. The functional integrals over ip(s) and 
ip'(s) are for < s < t, with boundary conditions ip(0) = C an d iip'(t) = z; ip 
and ip' are real. The symbol / T>ip is defined by the limiting process in Eq. (f2~3|). 
[The reader may wonder at this point what has become of the factors of 2n in the 
denominator of Eq. (|23|). The answer is that the prefactor, which for the moment 
is undefined, will be fixed via normalization.] Note also that the first term in the 
argument of the exponential could be written more precisely as iip'(t')?p(t'~), i.e., 
the time derivative is evaluated at t' — e with e — > from above. While the function 
ip'(t') has no obvious physical significance, we shall see that ip is closely related to 
the random variable n(t) in the birth-and-death process. 

The kernel Ut(z,() has two principal uses. First, from Eqs. (|15|) and 
see that Ut provides a mapping between PGFs at different times: 



M , we 



**(*) = [ ^e-^'U t (z,OM<) (f>0). 



(25) 



We make considerable use of this relation in the examples that follow. Evaluating 
the integral is particularly simple if the initial distribution is Poisson. Then $q(z) = 
e p{ - z - x \ and 



® t (z) =e~ p U t (z,p) 



(26) 



Another simple case isp n (0) = 5 ntno (exactly Uq individuals initially), corresponding 
to $0(2) — which yields 



d n °U t {z,() 



(27) 



C=o 
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Setting z = in the above expressions, we obtain the probability of the state n = 
0, which in many cases is absorbing, so that the survival probability is given by 
P s (t) = l-po(t). 

Independent of its probability interpretation, the kernel has a second utility: we 
may treat the argument of the exponential as an effective action. In the continuum 
limit of a system with many degrees of freedom, the function ip(t) becomes the 
classical field ^(x, £) (similarly for ip'(t)), leading to a field theory for a Markov 
process originally described by transition rates for particles on a lattice. (An example 
of this, for the problem of directed percolation, is discussed in Sec. VIII.) With such 
a field theory in hand, we can apply methods such as the renormalization group to 
study critical behavior. The effective action is known once we construct the evolution 
operator L; at no point do we need to write a Langevin equation or stipulate noise 
properties. 



III. DECAY PROCESS 



As a simple example we consider exponential decay, i.e., the Markov process with 
transition rates w m ^ n = wn5 m ^ n _i. The evolution operator is 

L = w(l-n)a. (28) 



Since this is in normal order, we have 

C = w{\ - (29) 



and thus, 



U t (z, ()=JvipJ V^j'exp - J*dtf (iip'(t')ip(t') + w(ii[>' - l)if) + zip(t) 



(30) 



It is convenient to transform away the linear term in the action via the change of 
variable iip = iip' — 1. The first term in the integral then contributes the additional 
(boundary) terms —ij)(t) + ij)(0), and using ^(0) = ( we have 



U t (z, ()=Jv^Jvijexp - J*dt'ii>[d t + w}ij + (z- l)ip(t) + C 



(31) 



This can be evaluated exactly. Recalling that / duie 1 
functional integral 



2tt5(z) , we see that the 



J Vipexp — J dt'iip[dt +w\ip 
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imposes the condition 

dip(s) 



ds 



-wip(s) (32) 



for < s < t, and so ip(t) = ip(0)e wt = (e wt . In other words the functional 
integral over ip yields a product of (^-functions: 

fvtjjexp - f dt'iif>[d t + w]il> = const, x J] ^O'(s) - (e~ ws ), (33) 

J L JO J 0<s<i 



which when inserted in Eq. fl3~T|) gives 

U t (z,C)= Cexp{C[l + (z- l)e- wt }}, (34) 

where C represents the as yet undetermined normalization factor. Using this in Eq. 
(p5|) results in 

= C [ ^ expRK' - »(1 + (* - l)e-^)]}$ (iC') 

= CJ d£5[iC -(l + (z- l)e- wt )]$ (i(') (35) 
= %[1 + (z - l)e~ w % (36) 

where in the final line we set C — 1 to satisfy the normalization condition, $(1) = 1. 
If there are exactly n particles at time zero, <&o(z) = z " '■> an d 



<S> t (z) = [ze~ wt + 1 - e~ wt ] n (37) 



which on expanding yields 



m (t) = I n J e- mu,i (l - e -^) n - m (3* 



as expected. 

For a Poisson initial distribution we find 

$ t ( z ) = e P(*-^- wt (39) 



corresponding to a Poisson distribution whose mean decays exponentially: p(t) 
pe~ wt . 
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A. Joint Probabilities 



It is useful to extend the formalism to joint probabilities, i.e., for the values of 
the process at different times. For t\ >t 2 , let P(ni, ti, n 2 , t 2 \no, 0) be the probability 
of state n% at time t% and n 2 at t 2 , given no at time 0. The generating function for 
the joint probability is 

$(z 1 ,t 1 ;z2,t 2 \no)= lL z? 1 z2 2 P(n 1 ,t 1 ;n2,t 2 \no,0) 

n\,ri2 

= « 2 ^K*ik,*2)P(n 2 ,t 2 |n ,0) 

ni,n 2 

= z^z^P(n 1 ,t 1 -t 2 \n 2 ,0)P(n 2 ,t 2 \n ,0) , (40) 



where in the second line we used the Markov property and in the third, stationarity. 

Let us modify slightly our notation for the one-time generating function, to 
include the initial condition, P{n, 0) = n (O) = 5 n>no : 

$(z,t\n ) =$>"P(n,t|n ,0) . (41) 



Then we have 

$(zi,ti; z 2 ,t 2 \n Q ) =5^$(«i,*i -t 2 \n 2 ) z^ 2 P(n 2 ,t 2 \n ,0) 

= Y,z?P(n 2 ,t 2 \n ,0) I ^e-^'U^z^CmCA^) (42) 



l\n 2 ^ 



where, in the second line, we used Eq. Now, noting that $(zC', 0|n 2 ) = (i( 

we have 

Hz^z.Mno) = J2 P (n 2 Mno,0) f ^e'^' (iz 2 CT 2 U tl -t 2 (zi, 

/ ^ e " iCC '^- 2 (^'C)e-^^(^C / ,0(^)"° • (43) 

Thus we have a formula analogous to Eq. (|25|), for the two-time generating function. 
The generalization to n times is straightforward. 



For the decay process, Eq. fl43|) reads: 

Hz^z.Mno) = J^J ^ e ^ ? ' ex P [C{(* - l)e"^-^ + 1} 

x e-* e exp k{{iz 2 (' - l)e~ wt2 + 1}} (i£') n ° , ( 44 ) 
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which, after integrations over 5-functions, yields: 



$(2i,ti;*2,t2|no) = {l + e-^ 2 [z 2 (( Zl -l)e- w ^^ + l) - l] }"° . (45) 



From this we readily obtain the expectation: 



_ a$(zi,ti;*2,t 2 |no) | _ 

— ^ |2i=Z2=l — C > 



(46) 



and 



(nin 2 ) 



9^1 9z 2 



I 21 =22 = 



(47) 



The covariance is then 



{{ ni n 2 ))=n e- w ^[l-e' wt2 }. 



(48) 



For t\ = t 2 we find ((n(t))) = n e wt [l — e wt ], which is the variance of a binomial 
random variable [see Eq. (|38])]. 



IV. PERTURBATION THEORY 



The preceding example illustrates the general procedure for calculating probabil- 
ities, but no perturbative treatment was needed as the action was purely bilinear in 
the fields. An example of perturbation theory is afforded by analyzing the Malthus- 
Verhulst process, in which each individual has a rate A to reproduce, and a rate of 
/j,+v(n—l) to die, if the total population is n. (The term oc v represents saturation, 
so that the population does not grow without limit even if A > fi.) For this process 
the kernel is 

C(z, C) = X(z - IK + Mi - *)C + f (i - z )<\ (49) 

since the corresponding evolution operator has the property 

L\n) = Xn[\n + 1) — |n}] + fin[\n — 1) — |n}] + un(n — l)[|n — 1) — \n)), (50) 

which evidently reproduces the rates defining the process. 
Using Eq. (EF) we have (with if) = iip'), 



U t (z,0=f?tyJvi)ex V 



dt' [iptp - \(ij)-l)i{nl^n(l-il>)il> 
v(l-xfiW 2 )+ zip(tj\ . (51) 



11 



As before, we eliminate the linear term by changing variables, ip = iip' — 1, yielding 
U t ( y z,()=J?tyJvijexp -J*d1? (xj>[dt>+w]i/> -A^V + ^(1+V# 2 ) 



+ C + (^-i)#)], 



(52) 



where w = /i — A. Separating the bilinear part of the action from the cubic and 
quartic terms, we have 



U t (z,C) = m V^exp 



<tf$[dv+w]il>+C+(z-l)il>(t) 



exp[-Sj], (53) 



where 



S I= f* dt'l-X^+iy^n+M 2 } = f dt'CAt'). 
Jo ' Jo 



(54) 



Evidently Si must be treated perturbatively. It is interesting to note that while 
the process with v — admits an exact solution, the cubic term generates a per- 
turbation series in the present formalism. When we expand e~ Sl we obtain a series 
of functional integrals over ip and ip of various products of these fields times the 
"Gaussian" factor e~ So . Consider the basic contraction: 



hKfi)^(f 2 )] = m / ZW(ti)^(f 2 ) exp - / dt'$[d t ,+w]ij +C + (z-l)^(t) 



(55) 



Let 



F[4>,ip} = exp 
= exp 



- fdt'^dv+w]^ +C + (^-1)^(0 
. Jo 

- fdt'ipi-dt'+w}^ + cfoKo) + 1] 



(56) 



where in the second line we integrated by parts and used the boundary conditions 
■0(0) = ( and ip{t) = z — 1. Since the contraction [ipit^ipfo)] is the functional 
integral of ipitijip^)^ , it is convenient to introduce the operator /C via the relation 



/C(* 2 )^[^]=# 2 )^# 



(57) 



The fact that 



Sip(t") 



(58) 



suggests that K, take the form 
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K{1*) = £dt»K(ir,t 2 )^ + B (59) 



where B is a boundary term. Using Eq. ( |58|) and integrating by parts yields 



o 



dt"i>{t"){d t „+w)K{t",t 2 ) + (2-l)«(t,t 2 ) -<0(O)K(O,t 2 ) 



J 7 . (60) 



Consistency with Eq. ( |57f) then requires that 

t 2 ) = -<*(*" -fe), (61) 

which has the 'causal' solution 

K(t",t 2 ) = -Q(t"-t 2 )e-^"- t2 \ (62) 

which leads to 

£(f 2 ) = -£ dt " e ~ Wit "~ t2) J^ + ( z ~ ^ w(t - t2 \ (63) 

as may be verified directly. 
To evaluate 

[V>(*i)# 2 )] = / vU{h)K,{t 2 )F{^ $) , (64) 



we make use of our earlier result, Eq. (p3|), to obtain: 

hWOlfaa)] = {-£^' e "" (t ''" t2) ^) + (^-1)^ ( " 2) | 

xe C+( 2 -iW) -Q £(^( s )_£ e -™). (65) 

0<s<< 



Now perform a functional integration by parts so that 5/5ij)(t") operates on ip(ti). 
This yields 



dt » e -™(t"-t2) 5 ( tl _ £") + ( Z -l) e -^(*-*2)^( tl ) 



xe C+( 2 -i)VW -Q 5 (^( s ) -Ce" ws ). (66) 

0<s<t 
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We may now integrate over ip to obtain 

= (^(ti)# 2 ))C/ t °(^C), 



(67) 



where 



C[l+(^-l)e- wt ] 



(68) 



In light of the discussion following Eq. (|24T ), we see that in Eq. ( p7|) and the 
subsequent expressions, t 2 should be interpreted as t 2 , which means that in the 
expectation, Eq. ([67]) , we should take 6(0) = 0. 



To see what our results mean, consider the very simple situation of Ci = uipip, 
which is equivalent to exponential decay with a rate w' = w + u. Then, 



e Sl = exp 



— u / dt'ijjijj 
Jo 



(69) 



and 



U t (z, C) = U?(l-u dt>^{t')i>{t')) + 0{u 2 ) 



u 



1 -u(z-l)(te- wt + 0(u 



(70) 



which leads to the exact result: 



D C[l+(z-l)e- wt e- ut ] _ ([l+(z-l)e- wt ] 



[1 -ut({z-l)e- wt + 0{u 2 )} 



(71) 



(Note that obtaining the correct result depends on using 6(0) = 0.) 

The preceding analysis exposes a curious feature of this formalism. Normally in 
a Gaussian model, the expectation of the field (if}) is zero. Here, by contrast, we 
have 



wt\ 7-7-O 

t ) 



(72) 



while from Eq. (|65f) we have 

h%)] = [i>j>fvfc(t 1 )r=(z-i)e- w <> t -vu?. 



(73) 



This suggests that it would simplify matters if we were to introduce new fields: 
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(74) 



and 



0(r) = i,(r) - (z-l)e-^\ 



(75) 



which by construction have expectation zero. The boundary conditions on ip and ip 
imply that <p(0) = (p(t) = 0. 



Noting that d t > + w annihilates e wt \ we have 



d1?4>(dt> + w)ij) 



dt'[<p + (z-l)e- w ^-* >](d tl + w)ip 
dt'ip(—d t '+w)0 — (z— l)ip(t), 



(76) 



where in the second line we integrated by parts and used the fact that —d t i + w 
annihilates e wt . Integrating by parts once again gives 

dt'i>{d t , + w)ij) = - f dt'0(d tl +w)<p- (z-l)[i/j{t) -Ce~ wt }, (77) 
o Jo 



which, when inserted in Eq. (|53p, yields 

U t (z,()=UH(z,0 fojv^exp 



— / dt'ip(d t i+w)<p 



-Si 



(78) 



The change of variable, then, yields the unperturbed solution, U®, automatically, 
and eliminates the boundary term from the exponential. The normalization is such 
that the functional integral is unity if Si = 0. 

We may now repeat the analysis of the basic contraction by letting 



Q[ip, 0] = exp 



dt'0(df+w)<f 



(79) 



and defining J such that 



J(t 2 )g = 0{t 2 )g. 



(80) 



One readily verifies that 



J(t 2 ) = - f dt"e- w ^"~ t2) 
ho 



5<p(t") 



51) 
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which leads directly to 



MhMh)} = u?(z,oe(t 1 -t 2 )e-^- t ^ 



12) 



Then an average of n fields (with equal numbers <£>'s and <£'s) may be written 

[<p(ti)<p{t 2 ) ■ ■ ■ <p(t n -i)<p(t n )] = U?{z, C) (v{h)0{t 2 ) ■ ■ ■ p(t n -i)0(tn)>, (83) 



with (<p(ti)0(t 2 ) ■ ■ • (p(t n -i)(p(t n )) given by the sum of all distinct products of pair- 
wise contractions of the form of Eq. (|82|) . 

Let us analyze the simple quadratic "perturbation" using the u tp" representation. 
Introducing the new fields we have 



Sj = -u I dt't/jip 



-u t dt'[<p + (z- l)e- w ^][ip + (e- wt '}. 
Jo 



54) 



which gives us 



U t (z, C) = Z7° J TXp J V(pQ[ip, tp] exp — u J d£ (<pcp + b<p + op) 



15) 



where 



b{t') = (z-l)e- w <-*-*' ) , 



c(t') = (e 



-wt' 



(86) 
(87) 



and 



f/f(^C) = exp[c(l + (^-l)e-^(l 



ut 



(88) 



Let U t (z,Q = Uf \z,QU(z, (). The latter factor has the expansion: 

00 ft fti ftn-l f f 

U(z,() = £M n /<fti/ dt 2 --- dt n -DpVtp&M + hK + cm) 
£? Q Jo Jo Jo J J 

X [0 2 (f 2 + b 2 if 2 + C 2 2 ] • ■ ■ \(p n <p n + b n ip n + C n n ] Q[(f, 0], (89) 

where (fj = <p(tj), etc. The n = term is unity (by normalization), while the n — 1 
term vanishes, since (<f(t')) = (<f{t')) = (<p(t')(p(t')) = 0. 
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For n — 2, of the nine possible terms in Cj, only one survives the functional 
integral, giving 

u 2 C dt x t dt 2 b lC2 ( Vl 2 ) = u 2 ({z - 1) f dt x f h dt 2 e- w{t - h) e' wt2 e- w{tl - t2) 
Jo Jo Jo Jo 

= ((z-l)e- wt{ ^f (90) 



Next consider the n = 3 contribution. Once again there is but a single nonzero 
term, since we must choose bi<fi for the first factor (there is no <p with time > t±, 
with which to contract ipi), 03^3 for the final factor (there is no ip with time < t%, 
i.e., no way to contract y^), while the middle factor must be (p 2 ^> 2 . Writing this 
contribution in terms of functional derivatives we have 

r*2 



-u 3 \ dh [ 1 d t 2 I 2 dhhcs \llp\v(p 
Jo Jo Jo J J 

f dt"e~ w ^"~^ f dt"'t 

lt 2 Jt 3 T T 6<p(t") 6<p(t 



x jy e -^ J' d re-^ W > ' g M (9!) 



Upon performing the two functional integrations by parts, S/Sip(t") may act on ip 1 
and S/Sip(t"') on ip 2 , or vice- versa. In the former case we obtain the factor 

C dt"e- w ^"-^5(t" - h) C dt"'e-^ t '"- t ^5{t'" - t 2 ) = e — (*i-*3). (92) 
Jt 2 Jt 3 

The functions can both be satisfied since ti G [t 2 ,t] and t 2 G [t 3 ,t\. On the other 
hand, the second alternative gives the factor 

f dt"e- w ^"-^5(t" - t 2 ) C dt"'e- w{t "'- t ^5{t"' - h) = 0, (93) 

Jt 2 Jtz 

since t" = t 2 does not fall within the range of integration. Combining this result 
with the other factors the third-order term becomes ((z — l)e~ wt (—ut) 3 /3\. 

We now introduce a diagrammatic notation which will prove essential in this and 
subsequent analyses. The three terms in Cj are represented by vertices, so: 

hipi < — > •-<— 



LPi0i < > < • < 



A contraction between ip^ and ipj (with t; L > tj due to the factor 0(tj — tj)) is 
represented by joining the line exiting vertex j with that entering vertex %. Thus 
the n = 2 and n = 3 terms correspond to the diagrams: 
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respectively. Associated with the line connecting vertices i and j (with t{ > tj), is 
the factor e~ w ^ i ~ t ^. 

Each diagram constructed according to the following rules corresponds to a term 
in the expansion of U. 

1) Draw m > 1 vertices of type •-<— and an equal number of type — <— • . Add p > 
vertices of type < • < , for a total of 2m + p vertices. 

2) Form all possible unlabelled diagrams, i.e., distinct connections in which each 
outgoing line is joined with an ingoing line. 

3) Generate all distinct labellings of each unlabelled diagram by assigning an index 
(time) to each vertex, such that the arrows always point from the larger to the 
smaller index. 

4) A diagram consists of one or more connected parts; its contribution to U is the 
product of factors associated with these connected parts. 

In the example under consideration, the factor associated with the j-th connected 
part (having Vj vertices) is 



fi = CO* - l)e 



-, t (-uty 

v 3 \ 



We now make use of a well known theorem in diagrammatic analysis (see, e.g., 



§8.3 of Ref. |15[), which in the present context states that In U t is given by the sum 
of all contributions associated with connected diagrams only. In the present case 
there is exactly one connected diagram at each order n > 2, yielding 



\ntJ t = ({z-l)e- wt J2 



-ut) n 



n=2 



111 



(94) 



which, when inserted in Eq. fl8"5p, gives the exact result, 

C) = exp [C (l + (z-l)e^ w+u » 



(95) 



While the expansion of In Ut in terms of connected graphs represents a consid- 
erable simplification, it is possible, in principle, to evaluate U t directly, without 
transforming to the fields ip and (p. Consider, for example, the second order term in 
the expansion of U t , Eq. (ffO|): 
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u 2 J dtxj dt 2 jTkp \V^T{ip,f) 



x 



f dre'^-^ 



+ b(h 



(96) 



Noting that the functional derivative w.r.t. ip(r) gives zero, the above expression is 
seen to be 



-u 2 t 2 ({z-l)e- wt [l + ((z-l)e- wt 



(97) 



which is precisely the 0(u 2 ) contribution in the expansion of U t , Eq. (|95|) . Clearly, 
this analysis is considerably more cumbersome than the connected diagram expan- 



sion. 



V. BIRTH-AND-DEATH PROCESS 

Next we consider the more complex, but still exactly soluble problem of a birth- 
and-death process without saturation, i.e., Eq. fl54|) with v = 0. Our first step, as 
before, is to rewrite the perturbation in terms of the variables ip and 0: 

A C dt'^jj 2 ^ = A C dt'[0 + b(t')] 2 [ v + c(t')} 
Jo Jo 

= X [ dt'[<p 2 (f + 2b(p(p + b 2 cp + c(p 2 + 2bc(f + b 2 c] . (98) 
Jo 

In the second line, the final term is independent of ip and ip. Integrating it, and 
combining it with the usual pref actor U®, we have for this problem 



C 1 + (z - l)e 



-wt 



+ -(z-lfe 
w 



-wti 



1-e 



-wt \ 



(99) 



The remaining terms will again be analyzed using diagrams. There are five vertices, 
as shown in Fig. 1 (note that the three we have encountered before carry different 
factors here). 

The first vertex in Fig. 1 ("terminal") must bear the lowest index of a given 
branch, since no lines exit from it. The second and fifth can only appear in the 
interior of a diagram, while the remaining two can only appear as the nth of an 
n-vertex diagram, since no lines enter. Thus the expansion is not as complicated 
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as it might at first appear. The lowest-order diagram is again • < • which now 
corresponds to 

2A 2 (z-l) 3 C tdt x dt 2 e- w( - 3t - 2tl -^e- w ^-^e-^ = ( -Y ({z-lfe- wt {l-e- wt ) 2 . 
Jo Jo \w J 



At third and higher orders there are graphs with bifurcations, the simplest being 
the one shown in Fig. 2, corresponding to 



2A 3 (^-1) 4 C tdtx [ h dt 2 f t2 
Jo Jo Jo 



dt -w{tt-2t x -2t 2 ) e -w(H-t a ) e -w{t2-U) e -wt3 



1-e 



(100) 



The factor of 2 arises because there are two ways to contract the ^-lines exiting 
vertex 3. Thus all the vertices in this problem, except for the terminal b 2 ip, carry a 
factor of 2, either explicitly, or due to the combinatorial factor. The other third-order 
connected diagram is 



4 C (z - l) 4 / dt x I 1 dt 2 I 2 dt 3 e 
Jo Jo Jo 



^ g— w(4t— 2tl-t2-t3)g— w(tl— t3) e ~Wt3 



3! [w 



c( z - iy e - wt (i - e~ wt f 



(101) 



The two diagrams differ only by their numerical prefactors, the sum of which just 
cancels the 1/3! that comes from the integrations. We show in the Appendix that 
this pattern continues at higher orders, i.e., that the sum of all numerical factors 
due to n- vertex diagrams is n\, so that 



ln^,C) = £[(A/™)(*-l)(l-e-^r 



(102) 



n=2 



Combining this with Eq. (P^|), we obtain the exact result \T%\ 

(z-l)e- wt 



U t (z,C) = exp 



C i + 



(X/w)(z-l)(l-e- wt ) 



(103) 



VI. EXPANSION OF MOMENTS 



While the transformation to variables <p and cp, with expectation zero, yields a 
certain simplifcation, it also causes a proliferation in the number of vertices, so that 
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in many cases it may be advantageous to work with the original variables ip and 
if). We have seen that in this case the expansion of U t becomes quite complicated. 
Fortunately, it is still possible to derive relatively simple expressions for the moments 
(n r (t)) of the distribution. 



Note that from the definition of <&t( z ) we have 



(n) 



d$t(z) 



dz 



z=l 



(104) 



and that, in general, the r-th factorial moment, (n r ) f = (n(n—l)(n—2) ■ ■ ■ (n—r+1)), 
is given by: 



dz r 



z=l 



(105) 



Using Eq. fl25|) we then have 



2tt 



dz r 



z=l 



(106) 



If Uf is of the form of Eq. (0), then 



2 = 1 



e c m Vi>7p(t) r g[7p,i>]exp[-S I ] . (107) 



(Note that the prefactor is just U° for z— 1.) Thus the expectation of the variable 
ip is closely related to that of n(t) itself. 

In case n(0) = n (so that §o(z) = z n °), we have, using Eq. (J27J), 



"(i 



:io8i 



C=o 



Evaluation of the above expression is facilitated by noting that 

d" 



n\ 



=0 {n-r)\ 



If the initial distribution is Poisson with parameter p, then Eq. (p6|) implies that 

(n r (t)) f = e-?ut\C=p)- (109) 
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It is instructive to evaluate the above expressions first for the simple decay 
process, Sj = 0. In this case 

and a short calculation shows that for the initial condition n(0) = n , 

(n(t))=n e- wt , (111) 

and 

Vax[n(*)] = n e- wt (l - e~ wt ) , (112) 

as expected. For the Poisson initial distribution, one finds that 

(n(t)) = Var[n(t)] = pe~ wt , (113) 

consistent with the probability distribution p n (t) being Poisson with parameter 
pe~ wt . 

Next we consider the moments for the birth-and-death process. In this case 

-Sj = A f dt'ij 2 ij 
Jo 

corresponding to a vertex that branches to the left. To evaluate U^ r \(), we expand 
e~ Sl , generating diagrams consisting of vertices and a single "sink", with r lines 
entering, to the left of all vertices. Each line entering a node (i.e., a vertex or the 
sink), corresponds to a variable tp(f); if not contracted, it contributes a factor of 
(e~ wt ' . (We call such uncontracted lines "external". Recall that for the birth-and- 
death process, w = /i — X.) On the other hand, lines exiting a vertex correspond 
to ip variables, and must be contracted with a ip line, because [ip] = when z — \. 
With z — 1, the basic contraction is: 

m^ih)) = 6(*i - t 2 )e~ w ^-^ . 



Thus the perturbation series for a given moment is much simpler than the full series 
for 0- 

Consider the case r — 1. The sink has only a single line entering, so diagrams 
with n > 1 vertices all give zero, and the only nonzero contribution to (dUt/dz) z= i 
is for n = (the sink itself), which is (e^e~ wt . 

For r = 2 the sink has two lines. There is then the n = contribution, ( 2 e^e~ 2wt , 
and the 1-vertex diagram shown in Fig. 3. Including the combinatorial factor of 2, 
its contribution is 
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2Ae c / dUMWh)) 2 ^-^ 1 = —Ce^e~ wt (l - e^ 4 ) 
Jo w 



Using these results, we readily find that 

(n(t)> = (n(0))e^ 



(114) 



For n(0) = n Q , the variance is 



Var[n(t)] = n,,— e^l - e" 10 *) 



(115) 



for w^O, while for w = we have 

Var[n(t)] = 2\n t 



(116) 



For a Poisson initial distribution, 

Var[n(t)] = pe"™* 



i + ^(i_ e -^; 



(117) 



which becomes p(l + 2Xt) in case w = 0. We see that at long times, the variance 
decays (grows) exponentially, for w > (w < 0), and that for w = the variance 
grows ~ t, reflecting the diffusive character of the process in this case. Higher- 
order moments may be evaluated similarly; only diagrams with n < r — 1 vertices 
contribute to (n r )f. 



VII. MALTHUS-VERHULST PROCESS 



We now return to the Malthus-Verhulst process; the three vertices associated 
with —Sj [see Eq. are shown in Fig. 4. The series for U^ r \() begins with the 

"sink" term, ( r e^e~ rwt , and then includes diagrams with n > 1 vertices. (Note that 
the n-th order contributions carry factors of (— u) s X n ~ s , with s variable.) Based 
on our diagrammatic analysis of the birth-and-death process, we can formulate the 
following simple rules for evaluating the n-th order contribution to U^: 

1) Draw all diagrams consisting of n vertices and a single r-line sink to the left of all 
vertices. Each line exiting a vertex must be contracted with a line entering another 
vertex to the left. 

2) The sink has time variable £; assign time variables ti,...,t n to the vertices from 
left (nearest the sink) to right. 
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3) For each external line include a factor of (e ~ WT , where r is the time variable of 
the associated vertex (if the external line is attached to the sink, r = t). For each 
internal line from vertex j to vertex i, (i < j) include a factor of e - ™^ - *^. 

4) Include the factors (A or —v) associated with each vertex, and the combinatorial 
factor associated with the number of ways of realizing the contractions. Finally, 
integrate over the time variables ti,...,t n , with 

* > h > t 2 > ■ • • > t n > . 



(Note that by fixing the time ordering we effectively include the factor \/n\ that 
comes from expanding e~ Sl .) 

Let us consider some examples in the evaluation of (n); the low-order diagrams 
are shown in Fig. 5. For n=l we have only diagram (a), whose contribution is: 

-KV [* dhe-^-^e-™ 1 = --C 2 e^e- w \l-e~ wt ) . 
Jo w 



At second order we have the following contributions. Diagram (b): 

ft ft! 



-2 Az<e c / dh ( 1 dt 2 e- w{t - tl) e- 2w{tl - t2) e- wt2 
Jo Jo 



2\v 



■ur 



<e'e 



C e -wt 



wt — 1 + e 



-wt 



Diagram (c): 



ft ft! 

2 i/ 2 CV / dt]_ / dt 2 e 
Jo Jo 



■w(t-ti) e -2w(t 1 -t 2 ) e -2wt2 



2u 2 



C 2 e c e- Wt \wt - 1 + e 



— wt 



Diagram (d): 



2 z/ 2 C 3 e c C dt x f 1 d^e^^e-^-^e-^e- 2 ^ 2 
Jo Jo 



3 e ( e -wt 



1-e 



—wt 



For fixed n(0) this yields the expansion: 



(n(t)) = n e 



-wt 



l--(n -l)(l-e- wt ) 
w 



(2[A+ (no-l)u][e- wt -l+wi\ - u{n -l)(n -2){l-e' wt ) 2 ) + 



(118) 
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For r = 2 a similar calculation results in 

~ 2wt - 2vn (n -l)te- 2wt 

-"*) [A-z/(n -l)(no-2)e- ttt 



(n(t)[n(t)-l]) 



+ 



n (n -l)e 
2 



n e~ wt (l-e 



+ 



119) 



The evaluation of diagrams can be simplified somewhat by considering the 
Laplace transform of (n r ) f. 

pOO 

(n r (s)) f = / dte- st (n r (t)) f 

We have seen that each line entering a node with time variable r carries a factor of 
e~ WT , and each line exiting the node carries a factor of e WT . Letting £; be the number 
of lines entering node i less the number exiting, we can write the time integration 
factor for the general diagram so: 

rt rt„-i 

e~ rwt / dt x ■ ■ ■ / dt n exv[-w{hh + ••• + Lt n )}- 
Jo Jo 

Inverting the order of the integrations, the Laplace transform of the above expression 
becomes: 

/•oo roc poo poo 

/ dt n / dt n _i • • • / dt x I dte- {s+rw)t exp[-w(£ 1 t 1 + • • • + £ n t n )} 
Jo Jt„ Jt 2 Jti 

1 1 1 

s+rw s+(r+£x)w s+ (r+£x + ■■ ■+£ n )w 



A. A numerical example 



The diagramatic expansion for the Malthus-Verhulst process can be extended, 
and simplified (by identifying the so-called reducible diagrams ||15||), but such analysis 
is beyond the scope of this article and will be defered to a future work. We close this 
section with an application of the second-order expansion for the mean population, 
Eq. (|118 ). Note that for short times, the factor multiplying n Q e~ wt may be written 



as 

l2 i 



f(t) = 1-At + Bt 2 + o(r 



with A = z/(n — 1) and B = u[(no — l)(n — 3)u — A] . Evidently, our analysis 
generates an expansion in powers of t, whose convergence would seem to require 
that vriat 1. 
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If we wish to extend the range of validity of the expansion, we must transform to 
a new variable that remains finite as t — > oo; a glance at Eq. suggests that we 

use y = l — e~ wt as the new variable. (This transformation is very useful in analysis 
of series, for example in the study of random sequential adsorption In fact, 

f(t) is readily expressed in terms of y: 

f( t ) = l-Ay + By 2 + 0(y 3 ) (120) 



with A = A/w and B = B/w 2 To proceed, we form a Pade approximant fllTjllS 
the power series in y: 



to 



f(y) 



1 + ay 
T+by" 



(121) 



Equating coefficients of y and of y 2 , we find 



b _ -B _ v(n Q -l)(no-3) - A 
A w(n — l) 



and 



b - A 



-r 2i/(no-l) + A 



w(n -l) 



(Here we must note that a Pade approximant to a series of three terms can only 
serve as a very rough approximation!) 

We apply this expression to the Malthus-Verhulst process with parameters fi = 
1, A = 0.5, and v = 0.1. In Fig. 6 we compare the numerical solution of the 
master equation with the perturbation theory expression, (n(t)) = n e~ wt f (t) (with 
/ represented by the Pade approximant), and with the simple exponential decay, 
n e~ wt , for n = 3 and n = 10. The perturbation expansion, using the Pade 
expression, yields a good approximation to the correct value, despite the very short 
series used, and the fact that for no = 10 we have puq = 1, so that the time series 
has only a small radius of convergence. 



VIII. COUPLED MALTHUS-VERHULST PROCESSES 



In this section we show how the path integral formalism can be applied to pro- 
cesses on a lattice, leading to a field theory in the continuum limit. The process of 
interest is a lattice of coupled Malthus-Verhulst processes, with diffusive exchange of 
particles between neighboring cells. This process describes the dynamics of a popu- 
lation distributed in space, with the individuals performing random walks, allowing 
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the population to spread. In the continuum limit, the process is of great interest as 
a field theory for directed percolation j7j . 



At each site r of the lattice, there is a process n T (t) whose evolution is given by 
Eq. fl50|). The new feature in this model is diffusion, represented by the operator: 



(122) 



where D is the diffusion rate and J2 e is over the vectors from a given site to its 
nearest neighbors. 

The evolution kernel U t is a function of the variables z r and ( r defined at each 
site; we use {z} and {(} to denote these sets of variables. To write Ut for this process 
we add the diffusive contribution to the Malthus-Verhulst part, Eq. fl5T|), to find 



Ut({z},{(})= T>l> /^exp 



J *• 



- A(^ r -l)^ r ^ r -^(l-^ r )^ r -Z/(l-^ r )^ r ^r)+X^r(t) 



(123) 



where Aip r = J^eO'r+e — 4>r) is the discrete Laplacian, and the functional integrals 
are now understood to include the funcions ip r and ip T at each site. Eliminating the 
linear term as usual, by letting ip = itp' — 1, and introducing w = fi — \, we obtain 



Ut({z}, {(}) =J^J Vfap -J/t' E + W - DA ^ 

- \fy r + l4 r (l+$ r )$)+ E[Cr + (2r-l)V>r(*)] 



(124) 



Up to this point, our expression for Ut is exact. We now make a number of 
simplifications, leading to an effective action for the lattice of coupled Malthus- 
Verhulst processes. (Each deserves a careful justification, but we shall not enter 
into such questions here.) 

i) We drop the boundary term, which should not influence stationary properties. 

ii) We take the continuum limit, so that ip r (t) —* ip(~x.,t), and Aifj r — > V 2 ^. 

iii) We discard the term oc ^ip 2 , which turns out to be irrelevant to the scaling 



behavior near the critical point [pi 



Under these approximations the argument of the exponential in Eq. ( |124j ) be- 
comes the effective action 
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S = Jdt' J d d x {ip(d t , +w- DV 2 )tp + vi)i) 2 - A^ 2 } . (125) 

This is the action corresponding to directed percolation p] or Reggeon field theory 
(a particle physics model with the same formal structure as the continuum theory 
of spatially extended population) [|19|,^(|. This theory has been analyzed using 
renormalization group techniques, to show that the upper critical dimension d c = 4, 



and to derive expressions for critical exponents in an expansion in e = 4 — d fl21| , |22 
While such developments lie beyond the scope of this article, we can get a qualitative 
understanding of the physics represented by S by ignoring, for the moment, the term 
oc tptp 2 . Functional integration over if) then imposes the following partial differential 
equation as a constraint on ip: 

^ = DV 2 ip -wip- uip 2 , (126) 

which is, in fact, the mean-field theory of directed percolation and allied models 
|[23|| . We see that this equation correctly predicts an absorbing state, i/j = 0. For 
w > the solution flows to this state, regardless of the initial condition. For w < 0, 
however, another stationary state appears: the uniform solution if) = |u>|/ia Thus 
w = marks a continuous phase transition. The field ^(x, t) may be interpreted as 
a local population density. This mean-field description is readily shown to yield the 
critical exponents (3=1 (for the order parameter (ip)), v\\ = 1 (for the relaxation 
time), and u± = 1/2 (for the correlation length) p3 |. 



In this case, the effect of the neglected term in the action, —Xipip 2 , can be 
represented by a noise term ^(x, t) in Eq. ( |126j ), which now becomes a Langevin 
equation or stochastic partial differential equation: 

^ = DV 2 i)-wip-vil) 2 + ri(x,t) } (127) 
at 

where rj is a Gaussian noise with (r/(x, t)) = and autocorrelation proportional to 
the local density 0: 

(tj(x, t) V (y, s) = A^(x, t)5 d (x - y)5(t - s), (128) 

(note that in this way the noise respects the absorbing state). In the presence of 
noise, the critical point is renormalized from its mean- field value of w c — 0, and, 
more significantly, the critical exponents take non-mean-field values for d < 4. 

As we have noted, the transcription of a stochastic model to a Langevin equation 
is not always straightforward. For this reason, the path-integral formalism discussed 
in this article is especially valuable: it allows on to construct an action (that is, the 
starting point for a renormalization group analysis), without having to postulate 
noise properties. In addition to the analysis of directed percolation discussed above, 



recent applications of the method include the annihilation reactions kA — > |24| , |25 
and branching and annihilating random walks p6[ . 
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IX. SUMMARY 



We have reviewed the formalism, based on the work of Peliti, that maps a Markov 
process to a path integral representation, and have presented detailed examples 
of its application to birth-and-death processes. We show, in particular, how the 
exact solutions for the decay and simple birth-and-death process can be recovered, 
and derive a perturbation expansion for moments in the Malthus-Verhulst process. 
Finally, we show how the evolution kernel for a lattice of coupled Malthus-Verhulst 
processes leads, in the continuum limit, to a field theory for directed percolation. 
As the study of nonequilibrium processes grows, we expect the methods discussed 
here to attract ever-greater interest. 
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Appendix 

We aim to show that the sum of all numerical weights associated with n-vertex 
diagrams in the expansion of lnU t for the birth-and-death process is n\. To see this, 
consider an arbitrary n, 6-diagram, i.e., one having n vertices, b of them bifurcations. 
There is a single factor of (, associated with vertex n. Such a diagram will have 6+1 
terminal vertices (carrying factors 6f), and so n — 2b — 1 nonterminal vertices that 
are not bifurcations, which carry factors bj. Each b k carries a factor of e~ wt (z — 1) 
for a total of n + 1 such. Next consider the factors e wtl for each vertex i. If i is 
terminal, there are two such factors (from 6f), and a factor e~ wtl due to the line 
entering the vertex. If % < n is neither terminal nor a bifurcation, there is a factor 
e wt t f rom ^ while the exponential factors associated with the lines entering and 
leaving the vertex cancel. If i < n is a bifurcation, there is no factor bi, but there is 
again a net factor of e wti as two lines exit, while only one enters vertex i. Consider 
vertex n. If it is a bifurcation, then the net factor is e wtn (two lines exiting, factor 
e -wt n j n c ^j_ rj^g same hoidg if vertex n is not a bifurcation (single line exiting, 
factors in bi and q cancel). In summary, there is a factor e wti associated with each 
vertex. Finally, all vertices carry a factor of 2, except for the terminal ones, leading 
to an overall factor of 2 n ~ 6 ~ 1 . Combining all of these observations, the contribution 
due to a given labelled n, 6-diagram is 



2 



,n— 6—1 



C (z-l)[X(z 



l)]"e 



(n+l)t 



n — 1 



dt n e w(tl+ - +tn) 



Jo Jo 




(129) 
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To find the contribution oc A™, it remains to evaluate the sum of all such terms, 
that is, to determine 

W(n) =^2 n - 6 ~ 1 (130) 



where the sum is over all distinct labelled diagrams of n vertices. A labelled n, b- 
diagram has a weight of 2 n ~ b ~ 1 . Let W(n,b) be the sum the weights of all n, b- 
diagrams. Define the degree of a vertex as the number of lines that exit from it, so 
that a terminal vertex has degree 0, bifurcations have degree 2, and all other vertices 
have degree 1. (In this model there are no vertices with degree > 2.) 

Now, given a labelled n, 6-diagram, we can generate a set of distinct n + 1-vertex 
labelled diagrams by the following recipe: 

i) Relabel the vertices l,...,n as 2,...,n+l. 

ii) Attach a new vertex ('1') to any vertex of degree less than 2. 

It is easy to see that (1) each choice for attaching the new vertex generates a different 
diagram; (2) the sets generated by different n-vertex labelled diagrams are mutually 
disjoint; (3) applied to the complete set of n-vertex labelled diagrams, the procedure 
generates the complete set of n+ 1-vertex diagrams. When we attach the new vertex 
to one of degree 0, the number of bifurcations does not change, so the new diagram 
has an additional factor of 2 in its weight. If on the other hand we attatch the new 
vertex to one of degree 1, we generate a new bifurcation, and the weight remains 
unchanged. Recalling that an n, b- diagram has 6+1 vertices of degree zero, and 
n — lb — 1 of degree 1, we have for n > 2 the following recurrence relation: 

W(n,b) = 2(l + 6)W(n-l,&) + (n-2b)W(n-l,b-l) . (131) 



Starting with W(2, 0) = 2 (and W(2,j) = for j > 0), we readily find W(3, 0) = 4, 
W(3, 1) = 2, and then W(A, 0) = 8, W(A, 1) = 16, and so on. 

To solve for Win) in general, we introduce a generating function 

#,2/)=EEA^. (132) 

n b n - 



(Since W(n) appears to grow like n! we need the factorial for g to have a nonzero 
radius of convergence. Without it, we get a function with an essential singularity 
at x = 0, as the reader may verify!) For purposes of analysis, it is convenient to 
define W(1,0) = 1 and W(l,j) = for j > 0, which is completely consistent with 
the recurrence relation for n — 2. (There is, of course, no diagram with n = 1.) For 
n — 0, W vanishes identically, so we must add a source term in Eq. ( |131| ). The 
modified recurrence relation, valid for n — 1, 2, 3, ... and b > 0, is 
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W(n,b) = 2(l+b)W(n-l,b) + (n-2b)W(n-l, 6-1) + 6 nA 8 w 



(133) 



Multiply this relation by x n y b / n\ and sum over n and b. Letting m = n — 1 and 
rearranging, one finds 

m+l b 

g(x,y) = 2£Et^ *[(i+b)W(m,b)-bW(m,b-l)] 

m>0b>0 l m + i J- 

+ x y y ^-W(m,b-1) + x . (134) 

— ' — 4 HI ' 

m>0 6>0 

Now let b' = 6—1 in the terms multiplying W(m, 6—1). After a simple rearrangement 
(and dropping the primes) we have 

g(x, y) = 2(l-y)[l+y—)yy W (n, b) + xyg(x, y) + x . (135) 

V °yj n>0b>0 \ n + 1 )- 

We require 

s xn^) = 

n>l 

For y — 1, Eq. (|135|) immediately yields = x/(l — x), implying W(n) = n.!. 
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FIGURE CAPTIONS 



FIG 



1 



Vertices in the birth-and-death process. 



FIG 



2 



An C(A 3 ) diagram in the birth-and-death process. 



FIG 



3 



One-loop diagram in the expansion of (n 2 )/ for the birth-and-death process. 



FIG. 4. Vertices in the moment expansion for the Malthus-Verhulst process. 

FIG. 5. Low-order diagrams in the expansion of (n) for the Malthus-Verhulst pro- 
cess. 

FIG. 6. Mean population size in the Malthus-Verhulst process with /i — 1, A = 0.5, 
v = 0.1; no = 3 (upper); no = 10 (lower). In each panel, the middle curve represents 
the exact (numerical) solution, the lower, the Pade approximant to the second-order 
perturbation series, and the upper, simple exponential decay, (n) = n e~ wt . 
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